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Abstract. Basic derivative formulas are presented for hypoelliptic heat semi- 
groups and harmonic functions extending earUer work in the eUiptic case. Fol- 
lowing the approach of |19J, emphasis is placed on developing integration by 
parts formulas at the level of local martingales. Combined with the optional 
sampling theorem, this turns out to be an efficient way of dealing with bound- 
ary conditions, as well as with finite lifetime of the underlying diffusion. Our 
formulas require hypoellipticity of the diffusion in the sense of Malliavin cal- 
culus (integrability of the inverse Malliavin covariance) and are formulated in 
terms of the derivative flow, the Malliavin covariance and its inverse. Finally 
some extensions to the nonlinear setting of harmonic mappings are discussed. 
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Let M be a smooth n-dimensional manifold. On M consider a globally defined 
Stratonovich SDE of the type 
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1. Introduction 




SX = A{X)6Z + Ao{X)dt 
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with Aq e r{TM), A e r(R'' (g) TM) for some r, and Z an R''-valued Brownian 
motion on some filtered probability space satisfying the usual completeness condi- 
tions. Here r(TM), resp. r{MJ' (E) TM), denote the smooth sections over M of the 
tangent bundle TM, resp. the vector bundle W (E) TM. 

Solutions to (jl.ip are diffusions with generator given in Hormander form as 

(1-2) L = Ao + lj2A^ 

where Ai — A{ - )ei € T{TM) and the zth standard unit vector in MJ'. 

There is a partial flow Xt{-), (,{■) to such that for each x Q M the process 
^tix), < t < C(2^)j is the maximal strong solution to (jl.ip with starting point 
Xo{x) = X and explosion time C{x). Adopting the notation Xt{x,uj) = Xt{x){uj), 
resp. ({x,ll>) = ({x){lu) and 

Mt(a;) = {x eM: t< C{x,uj)}, 

it further means that there exists a set fio C of full measure such that for all 
w £ fio the following conditions hold: 

(i) Mt{uj) is open in M for t>0, i.e. C( • is lower semicontinuous on M. 

(ii) Xt{- ,uj): Aft(cLi) — >■ Af is a diffeomorphism onto an open subset i?t(aj) of 
M. 

(iii) For t > the map s t-^ Xs{- ,uj) is continuous from [0, t] to C°° (Aff (w), Af) 
when the latter is equipped with the C°°-topology. 

Thus, the differential T^Xt: T^M Tx^M of the map Xt: Mt M is well- 
defined at each point x € Mt, for all lu E fto. We also write Xt^, for TXt. 
Let 

(1-3) {Ptf){x)=E[{foXt{x))l[t<ci.)}] 

be the minimal semigroup associated to (|l.ll) , acting on bounded measurable func- 
tions / : M ^R. 

Let Lie(^AQ, Ai, . . . , Ar) denote the Lie algebra generated by Aq, . . . , A,., i.e., 
the smallest R- vector space of vector fields on M containing Aq, . . . ,Ar and being 
closed under Lie brackets. We suppose that (jl.2[) is non-degenerate in the sense 
that the ideal generated by {Ai, . . . , Ar) in Lie(Ao, Ai, . . . , Ar) is the full tangent 
space at each point x £ M: 

(HI) Lie(A,, [Ao,Ai\ : i = I, . . . ,r){x) ^ T^M for all x & M. 

Note that (HI) is equivalent to the following Hormander condition for ^ -f L on 
R X Af: 

dimLie(^^ -f Aq,Ai, . . .,A,^ {t,x) = n + 1 for all {t,x) e R x Af. 

By Hormandcr's theorem, under (HI) the semigroup (|1.3I) is strongly Feller (map- 
ping bounded measurable functions on M to bounded continuous functions on M) 
and has a smooth density p e C°°(]0, oo[ x Af x M) such that 

P{Xt(x) edy, t< C{x)} =p{t,x,y)vo\{dy), t > 0, x E M, 

see [B] for a probabihstic discussion. 

In this paper we are concerned with the problem of finding stochastic representa- 
tions, under hypothesis (HI), for the derivative d{Ptf) of (|1.3I) which do not involve 
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derivatives of /. Analogously, in the situation of L-harmonic functions u: — >■ M, 
given on some domain Z? in M by its boundary values u\dD via 

(1.4) u{x) =E[uo X^(^^){x)], 

formulas are developed for du not involving derivatives of the boundary function; 
here t{x) is the first exit time of X{x) from D. 

The paper is organized as follows. In Section [2] we collect some background on 
Malliavin calculus related to hypoelliptic diffusions. In Section[3]we explain our ap- 
proach to integration by parts in the hypoelliptic case which leads to differentiation 
formulas for hypoelliptic semigroups. Section 2] is devoted to integration by parts 
formulas at the level of local martingales. In Section [S] control theoretic aspects 
related to differentiation formulas are discussed. It is shown that the solvability 
of a certain control problem leads to simple formulas in particular cases, however 
the method turns out not to cover the full hypoelliptic situation. We deal with the 
general situation in Section [7] where we refine the arguments of Section |4] and [5] to 
give probabilistic representations for the derivative of semigroups and L-harmonic 
functions in the hypoelliptic case. A crucial step in this approach is the use of the 
optional sampling theorem to obtain local formulas by appropriate stopping times, 
as in the elliptic case |19) , |21) . Our formulas are in terms of the derivative flow and 
Malliavin's covariance; hence they are neither unique nor intrinsic: the appearing 
terms depend on the specific SDE and not just on the generator. 

Finally, in Section |8l we deal with possible extensions to nonlinear situations, 
like the case of harmonic maps and nonlinear heat equations for maps taking values 
in curved targets. 

All presented formulas do not require full Hormander's Lie algebra condition (HI) 
but rather invertibility and integrability of the inverse Malliavin covariance which 
is known to be slightly weaker, but still sufficient to imply hypoellipticity of ^ + L. 
In particular, (HI) is allowed to fail on a collection of hypersurfaces. The reader is 
referred to 4 for precise statements in this direction. 



2. Hypoellipticity and the Malliavin Covariance 

Let B e r(TM) be a vector field on M. We consider the push-forward Xn,B 
(resp. pull-back X^^B) of B under the partial flow Xt{-) to the system (jl.ip . 
more precisely. 

Note that Xt^B, resp. X^^^B, are smooth vector fields on Rt, resp. Mt, well-defined 
for all a; G ilo- By definition, 

(X,,S),/-S^-i(^)(/oXt), x&Ru 

^^■^^ (xr,^s)./ = s^,(,)(/oxr^), xeMt, 

for germs / of smooth functions at x. 



4 M. ARNAUDON AND A. THALMAIER 

Theorem 2.1. The pushed vector fields X^^B and X^^J^B as defined by (|2.ip satisfy 
the following SDEs: 

r 

(2.3) S{X,,B) = [^t.B, A,] SZl + [X,,B, Ao] dt 

r 

(2.4) 6iX^,'B) = SZl + {X^Mo,B]) dt. 

1=1 

Proof. See Kunita [13], section 5. □ 

We have the famous "invertibihty of the Malhavin covariance matrix" mider the 
Hormander condition (HI), e.g., see Bismut [5], Prop. 4.1. 

Theorem 2.2. Suppose (HI) holds. Let a be a predictable stopping time, x £ M . 
Then, a.s., for any predictable stopping time t < C{x), on {a < r} 

J2 I {X-^A,)^ ® {X:,^Ai)^ ds e T^M ® T^M 

is a positive definite quadratic form on T*M. In particular, a.s., for each t > Q, 

(2.5) Ct{x) = ^ f{X;,'Ai)^ ® {X^Mi). ds 

^=l•^0 

defines a positive symmetric bilinear form on T*A'I for x € Mt- 

Thus, a.s., Ct provides a smooth section of the bundle TM ® TM over Mt with 
the property that aU Ct{x) are symmetric and positive definite. We may choose a 
non-degenerate inner product ( •, • ) on T^^M and read Ct{x) S TxM (S) T^M as a 
positive definite bilinear form on T^M: 

{Ct{x)u,v) = V / {{X-M^)x,u) {{X;,^A,),,v)ds, u,v€ T^M. 

Under (HI) the "random matrix" Ct{x) is invertible for t > and x G Mt. The 
following property is a key point in the stochastic calcuhis of variation, e.g., |17) . 

Remark 2.3. Under hypothesis (HI) and certain boundedness conditions on the 
vector fields Ao,Ai, . . . ,Ar (which are satisfied for instance if M is compact) we 
have (det Ct(a;))^^ G for all 1 < p < oo. In the same way, 

(2.6) (detCaix))-^ e LP for 1 < p < cx3 

if (T = (a;) or a = (x) A t for some t > where Tjj (x) is the first exit time of 
X.{x) from some relatively compact open neighbourhood D ^ M of x. Also note 
that Tjj{x) e LP for all 1 < p < oo, e.g. [S], Lemma (1.21). 

In the subsequent sections we adopt the following notation. By definition, 
Ct(x) G T^M ^T^M, thus Ctix): T*M T^M and Ct{xy^: T^M T*M. 
On the other hand, 

r 

(2.7) {X:}A), : W ^ T^M, z ^ ^(X^/A,), z\ 

i=l 



THE DIFFERENTIATION OF HYPOELLIPTIC DIFFUSION SEMIGROUPS 



5 



Let T*M ^ (M'T 

may write 



V be the adjoint (dual) map to p.7p . then we 



(2.8) Ctix)^ / {X;-,'A),iX-,'Ay*ds 

Jo 

for the Malliavin covariance. In the sequel we usually identify (R*")* and W . 

3. A Basic Integration by Parts Argument 

In this section we explain an elementary strategy for integration by parts formulas 
which will serve us as a guideline in the sequel. The argument is inspired by 
Bismut's original approach to Malliavin calculus [B]. 

Consider again the SDE (|l.ip and assume (HI) to be satisfied. For simplicity, 
we suppose that M is compact. Let a be a predictable process taking values in 
T^M (g) {Wy = T^M (g) W and A E T*M such that for each t > 0, 



(3.1) 



E 



expli 



|asA| ds 



< oo, A locally about 0. 



Let dZ^ — dZ + aX dt and consider the Girsanov exponential defined by 



(3.2) 



Gt = exp - 



(a., A, dZ.) - 



1 



sXfds 



Write for the fiow to our SDE driven by the perturbed BM Z^, analogously 
C^{x) etc. By definition, C^x) e T^M (g) T^M is a hnear map from T*M to T^M 
and C.-^(x)-i : T^M T*M. 

Lemma 3.1. For any vector field B G T(TM) we have 



A=0 



in terms of the Lie bracket [ , ] . 

Proof. Note that X^{x) — XfO Qi[x) where Q^[x) solves 

r dQ^=X^,\A){e^)atXdt 



Qo = X. 



In particular, we have 



d 
dX^ 



A=0 



^ f X-,\A,)afds. 



□ 



Moreover, from Xf^,{x) — {T^kj^^-^Xt^{TxQt) we conclude that 

{{Xtr'B)^ = {T,e^)-\T^.(,)XtY' B{Xto Q^{x)) ^ (r,^.^)-i(A,;^B),A(,) 
This gives the claim by definition of the bracket. 

Theorem 3.2. Let M he compact and f e C^{M). A ssume that (HI) is satisfied. 
Then, for each v € T^M , 

(3.4) d(Ptfyv^¥.[{foXt{x))<^tv\ 

where $ is an adapted process with values in T*M such that each $t is L^ for any 
I < p < oo. 
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Proof. We fix x and identify T^M with M". By Girsanov's theorem, for v G T^M, 
the expression 



is independent of A for any C^-function / on M. Thus 

y— 

which gives 



fffe(A) = 



A=0 



J2^\{Da){Xt{x))(xt. f\x;M'ha,ds) {Ct{x)-')^y 
i,k,e L V "'o / tk 



-EE 



f{Xt{x)) 



dXk 



k,i 

Note that 



d 



5) + 



A=0 



{C^{x)-')Jv 



A=0 



a* dZg 



where a* taking values in T^M (E) (W^)* is defined as the adjoint to a. Furthermore, 



d 

dXk 



A=0 



C^ix)] Ctix)-\ 

A=0 / 



Recall that (X-J-A)^ e (W)* T^M. We set 



where (Tn) is an increasing sequence of stopping times such that t„ t and such 
that each a" satisfies condition p.ip . This gives a formula of the type 

(3.5) E[{df)x,(.)Xt,CrAx)Ct{x)~\] ^E[{foXt{x))-<^'^v] 
Finally, taking the limit as n — > cxi, we get 

(3.6) d{Ptf)^,v = mdf)x,i:.)Xt,v] ^E[{foXt{x))-<^tv] 
where 



<i>tv 



(^j\x;M)^dz}jC^\x)v 

+ Y,(c,{xr^(^ C^{x)]c,{x)A V 

I. e V A=0 / / kl 



which can be further evaluated by means of p.3p . Eq. p.3p also allows to conclude 



that $t e np>iLP 



□ 
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4. Integration by Parts at the Level of Local Martingales 

Let F{ - , X.{x)), X e M be a family of local martingales where F is differentiable 
in the second variable with a derivative jointly continuous in both variables. We 
are mainly interested in the following two cases: 

F(- , X. (x)) — uo X. (x) for some L-harmonic function u on M, and 

F{ ■ ,X.{x)) — {Pt-.f)[X.{x)) for some bounded measurable / on M, t > 0. 

Let dF denote the differential of F with respect to the second variable. 

Theorem 4.1. Let F{ • , X.(x)), x ^ M be a family of local martingales as described 
above. Tfien, for any predictable W -valued process k in Ly^^{Z), 



(4.1) dF{.,X.{x)){nX.) {X-M).k,ds-F{.,X.{x)) {k,dZ), x e M, 

Ja Jo 

is a family of local martingales. 

Proof (by means of Girsanov). For e varying locally about 0, consider the SDE 

(4.2) 6X^ ^ A{X^-)5Z^ + Aa{X'')dt 

with the perturbed driving process dZ^ = dZ + e kdt. Then, for each e, 

(4.3) F{.,X!{x))G'. 

is again a local martingale when the Girsanov exponential Gf is defined by 

G; = exp(-/" e{k,dZ) -l-e^ f \k\'^ ds 
^ Jo 2 Jo 

Moreover, the local martingale (|4.3p depends on the parameter e (in the topology 

of compact convergence in probability) , thus 

is also a local martingale. Taking into account that 
d 



Gf 

e=0 



X'^{x)=X„ X-M{Xsix))ksds 

s=0 ' 



de 

and 

^ ' Gl = - I {k,dZ) 



d_ 



e=0 



we get the claim. □ 

Alternative proof (of Theorem 14. ip . First note that := dF{s, ■)xs{x) Xs*, as 
the derivative of a family of local martingales, is a local martingale in T*M, see [2]. 
Thus also ^ 

n, := mM^ — / rrirdh 



is a local martingale for any rj;A/-valued adapted process h locally of bounded 
variation. Choosing 

h= [\x;}A)^k,ds 
Jo 

and taking into account that 

F{.,X.{x))= I dFis, ■)x^(.)A{Xs{x))dZ, 
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the claim follows by noting that 

dF{s, ■)x^i:,)X,,dh,^F{.,X.{x)) [ {k,dZ) 

Jq 

where = denotes equality modulo local martingales. □ 

Let a be a predictable process taking values in T^M® {W)* as in the last section. 
The calculation above shows that 



dF{s, ■ )x^i.) Xs. ^ (X-^A)^ a, dr^ - F{s, Xs{x)) ^ < dZ^ 



is a local martingale in TxM which implies that 

iV, :— nM,, ^ Tir dhr 







is also a local martingale for any T^Af- valued adapted process h locally of bounded 
variation. In particular, choosing again = {X~^^A)*, we get 

= dF{s, . Xs, Cs{x) hs - F{s,Xs{x)) ^ {X~^A)x dZr^ h, 

dF{r, . X„ CAx) dhr + F{r, Xr{x)) ^ dZp^ dK. 



For the last term it is trivial to observe that 



F{r,Xr{x)) (^^ {X;,^A),dZp^dhr 

^ F{s, Xsix)) ^ ^ (^p*'^)x dZp^ dhr. 

Now the idea is to take h of the special form hg = Cs{x)~^ks for some adapted 
T2;M- valued process k locally pathwise of bounded variation such that in addition 
kr = V and fc^ = for s close to 0. Then the remaining problem is to replace 



(4.4) / dFir,.)x^ix)Xr,Cr{x)dhr 

Jo 

modulo local martingales by expressions not involving derivatives of F. This how- 
ever seems to be difficult in general, but in Section [7] we show that, more easily, the 
expectation of (|4.4p can be rewritten in terms not involving derivatives of F. 

5. Hypoelliptic Diffusions and Control Theory 

The following two corollaries are immediate consequences of Theorem 14.11 

Corollary 5.1. Let /: M ^ M. be bounded measurable. Fix x ^ M and v G T^M. 
Then, for any predictable MJ" -valued process k in Lf^^Z), 



{dPt-.f)x.{x){TxX.) v+ {X-M)xksds ^{Pt-.f){X.{x)) {k,dZ) 
'-Jo J Jo 

is a local martingale on the interval [0,t A C{^)[- 

Note that {dPt-.f)x.{x) {TxX.)v is a local martingale as the derivative of the 
local martingale {Pt-.f){X.{x)) at x in the direction v, see 
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Corollary 5.2. Assume that M is compact with nonempty smooth boundary dM . 
Let u e C{M) be L-harmonic on M\dM. Fix x € M\dM and v e T^M. Then, 
for any predictable -valued process k in Lf^^{Z), 



is a local martingale on the interval [0, r(x)[ where t{x) is the first hitting time of 
X.{x) at dM. 

Problem 5.3 (Control Problem). Let x £ M and v £ TxM . Consider the random 
dynamical system 



Let a = Tjj{x), resp., a = Tjy{x) A t for some t > 0, where Tjy{x) is the first exit 
time of X.(x) from some relatively compact open neighbourhood D of x. We are 
concerned with the problem of finding predictable processes k taking values in 
such that — 0, a.s. 

Example 5.4. Assume L to be elliptic, i.e., A{x) : W — > TxAI surjective for each 
x£ M. Then 



solves Problem [O] if the terms are defined as follows: A*{-) £ r{T*M (gi R'') is 
a smooth section and (pointwise) right-inverse to A{-), i.e. A(x)A*{x) = idx^M 
for X £ M, the process h may be any adapted process with values in T^M and 
with absolutely continuous sample paths (e.g., paths in the Cameron-Martin space 
H(R+, Ta;M)) such that ho = v and h^r = 0, a.s. Thus, for elliptic L, there are 
"controls" k transferring system (|5.1|) from z; to in time cr, moreover it is even 
possible to follow prescribed trajectories s n- from v to 0. In the hypoelliptic 
case, this cannot be achieved in general, since the right-hand side in 



is allowed to be degenerate. 

Under the assumption that Problem 15.31 has an affirmative solution, we get dif- 
ferentiation formulas in a straightforward way. 

Theorem 5.5. Let f : Af — > M 6e bounded measurable, x £ M, v £ T^M, t > 0. 
Let D be a relatively compact open neighbourhood of x and a = Tjj[x) A t where 
Tjj{x) is the first exit time of X.[x) from D. Suppose there exists an W -valued 
predictable process k such that 




(5.1) 




ks^ A*{Xs{x))T.,Xsh, 



{TxXs)hs^ A{Xs{x))ks 




am 



.d {J^ Iksl^ds)^^^ £ L^+^ for some e > 0. Then 



(5.2) 




where Ptf is the minimal semigroup defined by (jl.Sp . 
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Proof. It is enough to check that the local martingale defined in Theoreni l4.1l is actu- 
ally a uniformly integrable martingale on the interval [0, cr]. The claim then follows 
by taking expectations, noting that {Pt-af)iXa{x)) = E'^" [f (Xt{x)) l{i<c(x)}]- 
See Theorem 2.4 in [19 for technical details. □ 



Along the same lines, now exploiting Corollary 15. 2| the following result can be 
derived. 

Theorem 5.6. Let M be compact with smooth boundary dM ^ and let u £ C{M) 
be L-harmonic on M\dM . Let x G M\dM and v € T^M. Denote t{x) the first 
hitting time of X.{x) at dM. Suppose there exists an W -valued predictable process 
k such that 

r(x) 

{Xg^ A)^ks ds = V, a.s., 



and {Jq^^'' l^sP ds)^^^ G L^^*^ for some e > 0. Then the following formula holds: 

I-t(x) 

(5.3) {du).^v = E u{X.,(^){x)) i {k,dZ) 



In the elliptic case, formulas of type (15.21) and (|5.3I) have been used in [21] to 
establish gradient estimates for Ptf and for harmonic functions u, see also [8] for 
extensions from functions to to sections. Nonlinear generalizations of the elliptic 
case, e.g., to harmonic maps and solutions of the nonlinear heat equations, are 
treated in [5]. 

As explained, differentiation formulas may be obtained from the local martin- 
gales (|4.1|) by taking expectations if there is a "control" (kg) transferring the system 
()5.ip from ho — V to — 0. Solvability of the "control problem" is more or less 
necessary for this approach, as is explained in the following remark. 

Remark 5.7. Consider the general problem of finding semimartingales h, $ with 
ho ^ V and $0 = where h is Ta;M- valued and $ real- valued such that 

(5.4) Us ^ {dFs)x,{x)Xs^hs + Fs{Xs{x))^s, s>0 

is a local martingale for any space-time transformation F of the diffusion X(x) such 
that Fs{Xs{x)) = F{s, Xs{x)) is a local martingale. In the notion of quasideriva- 
tives, as used by Krylov [15l[T6], this means that ^ := (T^X) his a, F-quasiderivative 
for X along ^ at x and its F-accompanying process. Suppose that h takes paths 
in the Cameron-Martin space M{M.+ , T^M). Then, by choosing F = 1, we see that 
i> itself should already be a local martingale, say $s = {kr,dZr). Thus 



n — I {dFr)xr{x) Xr* dhr + / {dFr)xr{x) A{Xr{x))kr dr 
Jq Jo 



which implies 



{dFr)xr{x)Xr*dhr + / {dFr)x^{x) MXr{x))kr dr = 0, 
Jo 

i.e., {dFs)x,(x)Xs^hs + {dFs)xs{x) MXs{x))ks = for all F of the above type. 
Hence, assuming local richness of transformations F of this type, we get for s > 0, 

Xs, hs + AiX,{x))ks = 

or 

hs + iX-M)x ks - 0. 
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which means that k solves the "control problem" . 



Coming back to Problem 15.31 we note that since the problem is unaffected by 
changing M outside of D, we may assume that M is already compact. It is also 
enough to deal with the case a — Tj~, (x) where D has smooth boundary. 

Problem 5.8 (Modified Control Problem). Let 

cs{x) = -Cs{x) = ® (X,-iA,),. 

i=l 

Confining the consideration to R''-valued processes k of the special form 

r 

(5.5) h = Y,{ix;M^L,us)e, 

1=1 

for some adapted T^jM- valued process u, we observe that Problem 15.31 reduces to 
finding predictable T^M-valued processes u such that 



hs = Csix) Us 
Hq — V and h^r = 0. 



(5.6) 

This Problem 15.81 as well as Problem 15.31 have an affirmative solution in many 
cases. However, in the general situation, both problems are not solvable under 
hypothesis (HI), as will be shown in the next section. 

6. Solvability of the control problem: Examples and 
counterexamples 

We start discussing an example with solvability of the control conditions in a 
non-elliptic situation. 

Example 6.1. Let M = and Aq = 0, Ai{x) = (1,0), ^2(2;) = (0,a;i). Then 
[Ai,A2]{x) = (0, 1). The solution to 

6X = A{X)SZ 

starting from x — {x^,x'^) is given by 



Xtix) 

Consequently 



:^ + Zlx^+x^Zf+ f ZldZl 
Jo 



and the control problem at a; = comes down to finding k such that 



and [J^ \ks\^ ds) e L^+' . We may assume that \v\ = 1, and will further assume 

that a — Tjj or a — To A t where D is some relatively compact neighbourhood of 
the origin in R^. (After possibly shrinking D, we may also assume that D is open 
with smooth boundary.) Note that 
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Thus if Ainin(s) denotes the smallest eigenvalue of Cs(0), then 



(6.1) 



Amin(s) ^ 



i + \ZsV 

(Indeed, let a := Z], b := Z^, and x := 1 + = 1 + + 6^; then 
X — \J x^ ~ Aa^ 



Amin(s) — 



1- A 1- 



4a2 



> 



where we used 1 — y/1 — x > x/2). 

We construct h by solving the equation 



(6.2) 



where Xg — X^ (0) and (p is chosen in such a way that 

a' := inf{s > : = 0} < a. 

More precisely, take ipi G C^{D) with ifi\dD = and (/^i > in D. Similarly, for 
some large ball B in about (containing D), let ip2 G C^{B) with (p2\dB — 
and (^2 > in B. Let (p(a;, 2;) := ipi{x)(p2{z). We only deal with the case a = td, 
the case fi = A t is dealt with an obvious modification of (|6.2I) . Now, arguing as 
in the elliptic case, one shows 



/ Lp ^(Xg, Zs) ds = 00, a.s. 



Consequently, since 7^ with probability 1, we may conclude that also 

(^-"(X„Z,) ^ \ ., ds = ^, a.s. 



Note that 



-(^-2(X„Z,)(c,(0)/i„/i,) 



and hence by means of (16. ip . 



1- > 



(p-2(x„Z,)A„,i„(s)ds> / </.-2(^^^^^^) 



{ZD 



1\2 



l+\Zs 



■ ds 



which shows in particular that 



a'<inf{t>0:p-(X.Z.)J^ds^l}, 



It remains to verify the integrability condition, i.e., I |fcsp ds j G L^^^ where 

fc, = -^-2(x„z,)(x-i^);^. 

But, since on the interval [0,cr] the Brownian motion Z stays in a compact ball i3, 
and thus 



1 . \ * hs 



'\hs\ 



< C 



THE DIFFERENTIATION OF HYPOELLIPTIC DIFFUSION SEMIGROUPS 



13 



for some constant C, we are left to check 

/ ['"' \ 1/2 

which is done as in the elliptic case. 



Contrary to Example 16.11 the next example gives a negative result showing that 
in general Problem 15.31 is not always solvable. 

Example 6.2. (J. Picard) Let M = and take 

Aoix) = (0,0,0), Aiix) = (1,0,0), A2ix) = (0,1, x^) 
which obviously satisfy (HI). Then SDE ()1.1|) reads as 

Xtix) =x+ (^Zl Zl x^Zl + ^ Z\ dZ^^ . 

In particular, 

(x-Mi)(o) = (1,0, {x-,'A2m = {0,1, zl). 

Thus (|5.ip is given by 

h,^{kl,klzlk^-z^kl) 

where the problem is to find h such that ho ^ v = {v^,v'^,v^) and = 0. By 
extracting the third coordinate, we get Z^k'^ ds — Z^kl ds — —v^. On the 
other hand, an integration by parts yields 

r zlkl ds - r zlkl ds^- r hi dzi + r hi dzi 

Jo Jo Jo Jo 

where the condition on the integrability of k implies that — hi dZl + hi dZl 
is with expectation equal to 0. Combining both facts, we conclude that there is 
no solution satisfying the integrability condition if 7^ 0. 

Note that if a is not in L^, then the condition on the integrability of k does not 
imply any more that hi dZl + hi dZl is in L^. 

Remark 6.3. In Example 16.21 Malliavin's covariance is explicitly given by 

2 rt 



{CtiO)u,u)^y] f {iX„'A,m,u)^dr 
Jo 



u^Zl? + {u^ + u^Zl?] dr. 



Of course, Cf (0) — Cs(0) = Ci.(0) dr is non-degenerate for all s < t, nevertheless 
AminCs(O) = for cach fixed s, indeed: 



(c,(0)u,m) = {u^ - u^Zl) + [u^ + u^Zlf, u G ToM. 



The negative result of example 16.21 depends very much on the fact that a = gd 
is the first exit time of the diffusion from a relatively compact neighbourhood of 
its starting point. The situation changes completely if we allow arbitrarily large 
stopping times a (not necessarily exit times from compact sets). 

In the remainder of this section we give sufficient conditions for solvability of 
the control problem. We assume that diffusions with generator L have infinite 
lifetime, but do no longer assume that the stopping time u is of a given type. The 
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question whether in this situation, given solvabihty of the control problem, the 
local martingales defined in Theorem 14 . 1 1 are still uniformly integrable martingales, 
needs to be checked from case to case. 

We consider the following two conditions: 

Condition (CI). There exists a positive constant a such that for any continuous 
(non necessarily adapted) process Wt, taking values in {w G T^M, \\w\\ = 1} and 
converging to u almost surely. 



(6.3) / {cs{x)us,Us)i{cos{c,{x)us.u,)>a} ds ^ oo a.s. 
Jo 

Condition (C2). There exists a positive constant a such that for any uq G {w £ 

TxM, \\w\\ — 1}, there exists a neighbourhood Vug of uq in {w G T^M, \\w\\ — 1}, 
such that 

(6.4) / inf {{csix)u, u) l[cos{c,{x)u,u)>a}) ds ^ oo a.s. 

The following result is immediate: 

Proposition 6.4. Condition (C2) implies Condition (CI). 

Now we prove that the control problem is solvable under condition (CI). 

Proposition 6.5. Under Condition (CI), the control problem is solvable. More 
precisely, considering the random dynamical system 



(6.5) 



ho = V. 



there exists a (non necessarily finite) stopping time a and a predictable 'MS -valued 
process k S L'^{Z) such that the process h given by (|6.5p satisfies ha- = 0, a.s. 

Proof. We look for a solution of the control problem satisfying an equation of the 
type 

(6.6) hs = -(ps-r;^Cs{x)hs 

with Cs{x)u = J2l=ii^rJ'^i)x{{X~J-Ai)x, u), and where (fs takes its values in {0, 1}. 

Assuming that (CI) is satisfied, we construct a sequence of stopping times 
{Tn)n>o and a continuous process h inductively as follows: 

(i) To = 0; 

(ii) for n > 0, if /ly^^ = 0, then T2n+2 = 72„+i = T2„. 

(iii) for n > 0, if /ijvj^ ^ 0, ht is constant on [T'2n,72n+i] where 

T2„+i = inf{i > T2„, cos(ct(a;)/iT2„ , /it2„ ) > «}, 
and ht solves 

six)hs on [T2„+i,T2„+2] 



\\hs„ 

where T2„+2 = inf{i > T'2n+i, cos{ct{x)ht,ht) < a/2 or ht = 0}. 



THE DIFFERENTIATION OF HYPOELLIPTIC DIFFUSION SEMIGROUPS 



15 



Let 

a — \ni{t > 0, ht — 0} {— oo if this set is empty), 

and for s < cr, 

Vs = lu„[T2„+i,T2„ + 2[(s)> 

1 

(6-7) fcs = -1^5 'Yy\{Xs* ^i)x,hs)ei, 

where (ei,...,e,) denotes the canonical basis of R''. Then ht solves Eq. (|6.6p . 
hs = [X'^J- A)xks, and since 

we have 

(6.8) / ||fc.||'ds< ll/ioll- 

JO 

To conclude it is sufhcient to prove that solutions ht satisfy lims^o- hs = 0. 

First we remark that ht converges almost surely as t tends to a. This is due to 
the fact that 

\\dh\\ - ^II^H _ ^ --d\\h\\ 

cos{h,dh) cos{h,Cs{x)h) ~ a 

(recall d\\h\\ < 0); hence h has a total variation bounded by 2||/io||/a- 

We define Ut = ho/\\hQ\\ on the set where ht converges to as i tends to a, and 
ut = ht/\\ht\\ on the set where ht does not converge to 0. This provides a process 
which converges as t tends to a, but which is not adapted. On the set where ht 
does not converge to 0, we have 



ll^oll > - / d\\h\\> / {Csix)Us,Us)l{cos{c4x)u,.u,)>a}ds, 

Jo Jo 

which implies, by Condition (CI), that this set has probability 0. □ 
Example 6.6. Consider again Example 16. 2[ with M = M.^, 

Ao{x) = (0,0,0), Ai{x) = (1,0,0), A2{x) - (0,1, x^). 
For u € TqM, \\u\\ — 1, we have 

{cs{0)u, u) = {u^ - u^Zlf + [u^ + u^Zlf 

and 



cos(cs(0)w, u) 



((ul - m3^|)2 + (m2 + u^Zlf + (-^2^1 + Zlu^ + ||Z,||2u3)2)l/2 ' 

From there it is straightforward to verify that condition (C2) is realized in this 
case. With Proposition 16 . 51 we obtain condition (CI), and with Proposition 16 .41 we 
get solvability of the control problem. We stress again that now we allow a to be 
arbitrarily large. Then, contrary to the negative result of Example 16. 2) we are able 
to find h such that h^ = v, h„ = 0, hs = {kl,k1, Zlk'^-Z'^kl), and jfe^p ds G L^. 
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7. Derivative Formulas in the Hypoelliptic Case 

In this section the results of the Sections |3] and |4] are extended to derive general 
differentiation formulas for heat semigroups and i-harmonic functions in the hypo- 
elliptic case. 

Let again F{- , X.{x)), x S M be a family of local martingales where the trans- 
formation F is differentiable in the second variable with a derivative jointly con- 
tinuous in both variables. We fix x € Af and v S T^M . Let ct be a stopping time 
which is dominated by the first exit time of X. {x) from some relatively compact 
neighbourhood of x. We first note that 

(7.1) dF{Q, • )x« = E [dF{a, ■ )xAx) X„* v] 

where X^^, is the derivative process at the random time a. Eq. (|7.ip follows from 
the fact that the local martingale F{ • , X. (x)), differentiated in the direction v at x, 
is again a local martingale, and under the given assumptions a uniformly integrable 
martingale when stopped at a. Our aim is to replace the right-hand side of (17. ip 
by expressions not involving derivatives of F. To this end the local martingales of 
Section m are exploited. 

We start with an elementary construction. Let D C M be a nonempty relatively 
compact domain and tp € C^{D) such that ip\dD = and (p > on D. For x G D 
let 

(7.2) T(s)= / p-^Xr{x))dr, s<td{x), 

Jo 

and 

(7.3) (7{r) ^ inf {s > : T(s) > r} < td{x). 

Note that T(r) — >■ oo as r td{x), almost surely, see [21]. Fix > Q and consider 

(7.4) i^ = l-p(^j^ <^-2 {Xr{x)) dr^ V 

for some p G C^{M.+ ,M.) such that p{s) = for s close to and p{s) = to for s > to. 
Then = and is = v ior s > a{to). 

Now for perturbations X^ oi X, as in Section |31 let 

i^^^^p(^J\-^{X^ix))dry 

and (T'^(r) — infjs > : T'*'(s) > r}. We introduce the abbreviation = 
(aXT' ■ • ■ ' Then dxl-^^^ig exists and lies in HpyiL^, see [21], Section |4| (the 

arguments there before Theorem 4.1 extend easily to general exponents p). In a 
similar way, using T^oa^ = id, we see that 

For our applications, it is occasionally useful to modify the above construction 
such that already = w for s > a{to) A t where t > is fixed. This can easily be 
achieved by adding a term of the type tan(7rr/2i) to the right-hand side of ()7.2|) 
and by changing the definition of £s in an obvious way. 

Now let again F{ • ,X.{x)) be a local martingale, as in Section S] and consider 
the variation 

(7.5) F{.,X^ix))G^ 
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a., A, dZ^ - 



X-}A{Xr{x)) ardr]- F{s, X,{x)) / < dZ, 



of local martingales where 

(7.6) = exp 
Then 

Us = dF{s, ■ )x,(x) 

is a local martingale in T^M. Observe that n is the derivative of (I7.5P at with 
respect to A, i.e., — d.^\^_^F(^s,X^{x)) G^. In particular, taking 

(7.7) as = {X-M)l, 
then 

Us = dF{s,.)x,i^)Xs,Csix) ~ F{s,Xs{x)) f {X„'A),dZr. 

Jo 

This implies that also 



. dhr 



is a local martingale for any T*Af-valued adapted process h locally of bounded 
variation. We choose hg = Cs{x)~^£s where £ is given by (17. 4p . Taking expectations 
gives 

(7.8) dF(0, ■y,v = E [dF{a., ■ )x^(.) X„ v] 



F{a,X,{x)){ {X-,'A),dZ,Ac-\x)v+ n,dh 



E 



where a := cr(to). We deal separately with the term 



(7.9) 



E 



; dh,. 



d^\^^^[F{s,X^{x)) G^]d{Cs{x)-'ls) 



To avoid integrability problems, it may be necessary, as in proof of Theorem 13. 2 
to go through the calculation first with (|7.7p replaced by 



where (r^) is an appropriate increasing sequence of stopping times such that cr, 
and to take the limit as fc — )■ cx) in the final formula. Note that, without loss 
of generality, a may be assumed to be bounded. We shall omit this technical 
modification here. 

We return to the term (17.91). Observe that 



E 



F{s,X^{x))G^d{C^{xr^t 

E \^,^,.yF{s,X^{x)) G^ ^^{C^{x)-H^) 



ds 
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is independent of A. Thus differentiating witli respect to A at A = gives 



E 



n, dhs 



= -E 



-E 



d 



F„ 



d 
ds 



F,d{Cs{x)-Hs 



A=0 



where Fs = F(^s, Xs{x)) . Note that all terms in the last line are nicely integrable. 
Substituting this back into Eq. ()7.8p . we find a formula of the wanted type: 



(7.10) 



dF(0, 



E[F{a,X,{x))<i>^v] 



where $0- takes values in T*M and is LP-integrable for any 1 < p < 00. Summa- 
rizing the above discussion, we conclude with the following two theorems. 

Theorem 7.1. Let M be a smooth manifold and f: M — > M a bounded measurable 
function. Assume that (HI) holds. Let x £ M , v £ T^M , t > Q. Then 



d[PtJ)xV - E f{Xt{x)) l{t<ax)} ^tv 



(7.11) 



for the minimal semigroup Ptf defined by (|1.3p where $t is a T* M -valued random 
variable which is L^ -integrable for any I < p < 00 and local in the following sense: 
For any relatively compact neighbourhood D of x in M there is a choice for $t 
which is ^^-measurable where a = t A Tjj{x) and Tjj{x) is the first exit time of X 
from D when starting at x. 

Proof Let F{-,X.{x)) = {Pt-.f){X.{x)) . Then Eq. (iTAOl) gives 

d{Ptf)xV ^E[F{a,X,{x)) <i>„] 

Again by taking into account that {Pt-af)[Xa{x)) — E'^' [/(Xt(a;)) l{t<c(a;)}] ; 
get the claimed formula. □ 

Theorem 7.2. Let M be compact with smooth boundary dM ^ and u G C{M) be 
L-harmonic on M\dM . Assume that (HI) holds. Let x G M\dM and v G TxM . 
Denote t{x) the first hitting time of X.{x) at dM. Then the following formula 
holds: 



(7.12) 



{du)xV = E[u{Xr(^x)(x)) ^r{x)v] 



where ^r{x) o T* M -valued random variable which is in L^ for any 1 < p < co 
and local in the following sense: For any relatively compact neighbourhood D of x 
in M there is a choice for ^t{x) which is already .^a- -'measurable where a ~ Tuix) 
is the first exit time of X from D when starting at x. 

Proof. The proof is completely analogous to the proof of Theorem 17.11 □ 

Example 7.3 (Greek Deltas for Asian Options). Consider the following SDE on 
the real line: 



(7.13) 



dSt = aiSt)dWt-^fi{St)dt, 
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where Wt is a real Brownian motion. In Mathematical Finance one likes to calculate 
so-called Greek Deltas for Asian Options which are expressions of the form 

Ao = t^E[/(5t,At)], r>o, 

where St is given as solution to (|7.13l) and 

(7.14) At^ [ Srdr. 

Jo 

We may convert (|7.13p to Stratonovich form 

dSt - cr{St) SWt + m{St) dt 
and consider Xt := {St, At) as a diffusion on M^. Then 

with the vector fields 



_ fm{xi)\ _ fa{xi) 

^°-(, XI J' 

Observe that 

Thus if (7 > 0, then Xt — (St, At) defines a hypoelliptic diffusion on M^. 

Example 7.4 (Trivial example). In the special case ct > constant and fi — 0, 
i.e., 

dSt = a dWt 



dAt — St dt, 



one easily checks 



Xt*^(] Jj and X-\A,)^X-\A,) = a^(^\ J,, 

and hence 

Consequently, the integration by parts argument of Sect. [3] immediately gives 



J-E[/(..,A.)].A: 



1 r... . 1, 



/{St, At) \- J Wtdt - -Wt 



Remark 7.5. In the more general situation of Example 17.31 i.e., 

dSt = o-{St) dWt + ^^iSt) dt and At ^ [ Sr dr, 

Jo 

Theorem 17.11 may be applied to give a formula of the type 

Ao - ^E[f{ST,AT)]=E[fiST,AT)n^], 
Coo 

where the weight ttt is explicitely given and may be implemented numerically in 
Monte-Carlo simulations. See [7] for extensions to jump diffusions, and [T^] for 
weights TTrp in terms of anticipating integrals. 
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8. The Case of Non-Euclidean Targets 

The aim of this section is to adapt our method, to some extent, to the nonlinear 
case of harmonic maps between manifolds. In addition to the manifold A/, carrying 
a hypoelliptic L-diffusion, we fix another manifold N, endowed with a torsionfree 
connection V. In stochastic terms, a smooth map u: M N is harmonic (with 
respect to L) if it takes L-diffusions on M to V-martingales on N. Likewise, a 
smooth map u: [0,t\ x M ^ N is said to solve the nonlinear heat equation, if 
u(t — • ,X.{x)^ is a V-martingale on N for any L-diffusion X.{x) on M. 

Henceforth, we fix a family F{- ,X.{x)), x e M of V-martingales on N where F 
is differentiable in the second variable with a derivative jointly continuous in both 
variables. In particular, such transformations F map hypoelliptic L-diffusions on 
M into V-martingales on N and include the following two cases: 

F{ - ^X. {x)) — uo X. (x) for some harmonic map u: M ^ N , and 

F{ • , X.{x)) — u(t — • , X.{x)) where u solves the heat equation for maps Af N. 



Theorem 14. II is easily extended to this situation. Recall that, if F is a continuous 
semimartingale taking values in a manifold N endowed with a torsionfree connec- 
tion V, then the geodesic (damped or deformed) transport Qq ^ : Ty^N — >■ Ty^N on 
N along Y is defined by the following covariant equation along Y: 



i.l) 



dU/o'^o,.) = --2 //o'Ri^o,. dY)dY 



©0.0 = id 



where //q ^ : Ty^N — >■ Ty^N is parallel translation on A'' along Y and R the curvature 
tensor to V, see Finally, recall the notion of anti-development of F, resp. 
"deformed anti-development" of F, 



(8.2) ^{Y)^ //^-JSY,, =<iet(n= / ©oi'^n 

Jo Jo 

which by definition both take values in Ty N. Note that an iV-valued semimartin- 
gale is a V-martingale if and only if ^(y), or equivalently ^ef(i^), is a local 
martingale. 

Theorem 8.1. Let F( - , X.{x)), x G M be a family of V -martingales on N, as 
described above. Then, for any predictable W -valued process k in Lf^^^Z), 

(8.3) %UF{.,X.{x)){T,X.) f {X;M)^k,ds - j^d,{{F{. ,X.{x))) f {k,dZ) 

Jo Jo 

is a local martingale in Tp(^Q ,^jN. Here 0o,. denotes the geodesic transport on N 
along the martingale F{ • ,X.{x)). 

Proof. Observe that by [3], 

is local martingale taking values in TxM ® Tp(^Q ,^jN, and that by definition, 

j^d4F{.,X.{x))) = f e^ldFis, ■)x4x)A{Xs{x))dZs. 
Jo 

The rest of the (alternative) proof to Theorem 14.11 carries over with straight-forward 
modifications. □ 
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It is straightforward to extend Theorem 15.51 and Theorem 15.61 to the nonhnear 
setting by means of the local martingale (|8.3|) . 



Theorem 8.2. Let u: [0,t] x M ^ N be a solution of the nonlinear heat equation, 
X € M , V € TxM . Let D be a relatively compact open neighbourhood of x and 
a = Tj-,{x) A t where T]j{x) is the first exit time of X.{x) from D. Suppose there 
exists an W -valued predictable process k such that 



{XgJ^A)xksds = V, a.s. 



d (^J^ ds^^^"^ £ L^^^ for some e > 0. Then the following formula holds: 



(8.4) 



^dcf(u(t--,X (a)))^ / {k,dZ) 



Theorem 8.3. Let M be compact with smooth boundary dM ^ 0. For x € M\dM 
let t{x) be the first hitting time of dM with respect to the process X.{x). Given 
V e TxM , we suppose that there exists an W -valued predictable process k such that 

{X^J-A)^ kg ds = V, a.s. 



and {J^^"'^ \ks\^ dsf^ e L^+^ for some e > 0. Then, for any u G C°°(M, N) which 
is harmonic on M\dM , the following formula holds: 



(8.5) 



{du)xV = E 



=<ief(«(X(a;))) / {k,dZ) 



-{x) 



Note that if a is a predictable process taking values in T^M ® {W)* , as in 
Section m then 

(8.6) Q^UF{.,X.{x)){TxX.) [ {X-}A)^a,ds-^A,i{F{.,X.{x))) f < dZ, 

Jo JQ 

gives a local martingale in T^M ® Tp(^Q x)N. In particular, setting 

(8.7) as^{X;-Mrxhs<r}, 

where r may be any predictable stopping time, we see that 
(8.8) 

Us = QoUF{s,-)x^ix) Xs.Cs^Ax) - ^dcfiF{- ,X.{x))) ^ / (X„M), dZ, 

Jo 

is a local martingale. Let 

(8.9) y = ^dcf(F(.,X(a;))) and = ^dct(F( • , X-^(a;))) . 

for variations X^(x) of X{x), as in Section |31 and recall that, again with the 
choice (lO) . 

(8.10) Js = d^\^^^F{s,X^{x)) ^ dF{s,.)x^^^,)Xs.Cs^rix). 

By definition, J.u; is a vector field on N along the martingale F{ ■ ,X.{x)) for each 
w € T*M. Imitating the strategy of Section [71 the idea is to differentiate Yj^ 
with respect to A. 
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Lemma 8.4. Keeping the notations as above, we have 

(8.11) vert[a,|^^^y^] =eoV- Jo+ / %,l{VQoJdY, 

Jo 

where V8g _ : Tp^^Q r^-^N — > Tp^ . _x.(x))N defined by 

(8.12) i'^Qo> = ^j\H,.hj„{u)y"'). 

In particular, vert [9;^ |_!^_q^^] cii^'d Oq]J ~ Jo differ only by a local martingale. 
Here Qq _ denotes the geodesic transport on TN along J with respect to the complete 
lift V of the connection V. 

We are not going to prove Lemma here . We just remark that, again with the 
choice (|8.7p for the process a, we end up with the foUowing local martingale: 



m Invert [d^\^^,{Y'G^)] 

(8.13) /•• /--^^ 

= Go y - Jo + / %l^Qo,s dY^^Y (X-M), dZs. 
Jo Jo 

Then a procedure along the lines of Section [7] leads to a formula for dF{Q, • )xV 
which is analogous to the linear case, but with an additional term of the type 



(8.14) E 



£ eo's^jeo,sdYs)c-\x)v 



for some stopping time a. At the moment, it seems unclear whether it is possible 
to avoid this extra term. 



9. Concluding Remarks 

1. The presented differentiation formulas are not intrinsic: they involve the deriva- 
tive flow which depends on the particular SDE and not just on the generator. It is 
possible to make the formulas more intrinsic by using the framework of Elworthy, 
Le Jan, Li [101, [H] on geometry of SDEs (e.g., filtering out redundant noise and 
working with connections induced by the SDE). 

2. In this paper we exploited perturbations of the driving Brownian motion and 
a change of measure as method for constituting variational formulas. There are of 
course other ways of performing perturbations leading to local martingales which 
are related to integration by parts formulas. For instance, one observes that the 
local martingale property of _F( • , X.{x)) is preserved under 

(i) a change of measure via Girsanov's theorem, 

(ii) a change of time, 

(iii) rotations of the BM Z. 

In particular, (iii) seems to be promising in the hypoelliptic context since it leads 
to contributions in the direction of the bracket [Ai,j4j]. So far however, it is un- 
clear to us how to relate such variations to regularity results under hypoellipticity 
conditions. 
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